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Operator  Performance  as  a  Function  of  Type 
of  Display:  Conventional  versus  Perspective 


SUZANNE  V,  BEMIS,‘  JEFFREY  L.  LEEDS,  and  ERNST  A.  WINER,  Naval  Ocean  System 
Center,  Sati  Diego,  California 


The  purpose  of  this  experiment  was  to  evaluate  operator  performance  on  a  perspective  tacti¬ 
cal  display.  The  distinguishing  feature  of  the  perspective  display  is  its  visual  representation 
of  vertical  as  well  as  horizontal  craft  information.  In  contrast,  current  tactical  display  sys¬ 
tems  provide  only  two-dimensional  views  requiring  numerical  representation  for  altitude 
information.  Subjects  were  required  to  perform  two  tasks:  detect  threats  and  select  the  clos¬ 
est  interceptor  for  each  detected  threat.  Errors  and  response  time  were  recorded  for  each 
subject  by  the  computer  in  a  completely  within- subjects  experimental  design.  The  experiment 
revealed  a  significant  reduction  in  errors  of  detection  and  interception  with  the  use  of  a 
perspective  display.  Response  time  for  selecting  interceptors  was  greatly  reduced.  The  dis¬ 
cussion  recommends  relevant  directions  for  future  research. 


INTRODUCTION 

With  the  advent  of  more  sophisticated 
computer  hardware  and  increased  computer 
display  resolution,  new  options  are  available 
for  communicating  information  to  tactical 
display  operators.  In  the  present  study  a  per¬ 
spective  display  was  investigated  for  naval 
tactical  display  systems.  In  contrast  to  con¬ 
ventional  tactical  displays,  this  perspective 
display  depicts  vertical  as  well  as  horizontal 
information  for  aircraft,  surface  vessels,  and 
submarines. 

The  purpose  of  this  research  was  to  com¬ 
pare  operator  performance  on  a  conventional 
tactical  display  with  performance  on  the  per¬ 
spective  display  to  determine  the  signifi¬ 
cance  of  vertical  information  in  cases  in 

'  Requests  for  reprints  should  be  sent  to  Su/anne  V. 
Bemis.  Naval  Ocean  Systems  Center.  Code  441, 271  Cata¬ 
lina  Blvd  .  San  Diego,  CA  92152-5000. 


which  relative  altitude  differences  between 
threats  and  interceptors  may  be  important. 
In  conventional  tactical  displays  the  operator 
"hooks”  the  symbol  to  obtain  altitude  infor¬ 
mation  from  data  readouts.  With  a  perspec¬ 
tive  display  relative  altitude  information  is 
quickly  visible  while  more  accurate  informa¬ 
tion  may  still  be  obtained  from  data  read¬ 
outs. 

Background 

Conventional  naval  displays  present  infor¬ 
mation  to  the  operator  on  the  relative  posi¬ 
tion.  orientation,  and  movement  of  aircraft, 
ships,  and  other  platforms.  On  the  basis  of 
this  information  the  operator  makes  recom¬ 
mendations  and  takes  actions  involving  the 
deployment  of  friendly  assets.  Use  of  a  per¬ 
spective  display  may  enhance  such  opera¬ 
tions  by  reducing  the  information-processing 
load  for  the  operator  and  decreasing  operator 
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reaction  times.  Uttal,  Azzato,  and  Brogan 
(1982)  indicate  that  another  advantage  of 
perspective  displays  may  be  higher  margins 
of  safety  in  critical  control  situations.  Merritt 
(1982)  suggests  that  previous  research  has 
not  evaluated  perspective  displays  in  many 
applications  because  of  the  belief  that  per¬ 
spective  information  may  be  irrelevant  to  a 
particular  task. 

Recently  a  study  by  Smith,  Ellis,  and  Lee 
(1984)  used  data  tags  on  a  conventional  dis¬ 
play  to  provide  altitude  information  to  pilots 
in  a  simulated  perceived  threat  and  avoid¬ 
ance  scenario.  This  study  found  that  the  ma¬ 
jority  of  maneuvers  made  by  pilots  using 
conventional  displays  were  in  a  horizontal 
rather  than  vertical  fashion.  However,  Ellis 
and  McGreevy  (1983)  suspected  that  this  ten¬ 
dency  to  maneuver  in  a  horizontal  fashion 
could  be  a  result  of  the  type  of  display  and 
encounter  used.  Specifically,  the  preference 
for  horizontal  avoidance  maneuvers  could  be 
unique  to  a  conventional  display  with  only 
two  dimensions  portrayed.  Accordingly, 
avoidance  maneuvers  could  be  modified  by 
implementation  of  a  perspective  display  for 
oncoming  traffic.  Pilots  would  then  be  able 
to  maneuver  more  frequently  in  a  vertical 
fashion. 

Ellis  and  McGreevy  (1983)  compared 
pilots’  avoidance  maneuvers  when  using  a 
perspective  cockpit  traffic  display  with  their 
avoidance  maneuvers  on  a  conventional 
plan-view  display.  These  avoidance  maneu¬ 
vers  included  turns  toward  the  intruding  air¬ 
craft  or  away  from  the  intruding  aircraft 
while  the  altitude  remained  approximately 
the  same.  Aircraft  on  the  conventional  and 
perspective  displays  were  represented  by 
schematic  airplane-like  symbols.  Vertical 
lines  on  the  perspective  display  extended 
from  the  symbol  to  a  grid  on  which  horizon¬ 
tal  separation  was  represented.  Tic  marks  on 
the  vertical  lines  in  the  perspective  display 


divided  present  or  future  positions  of  aircraft 
into  intervals  of  1000  feet  (304.8  m).  The 
number  of  vertical  maneuvers  pilots  made 
with  the  perspective  display  increased  two¬ 
fold  over  the  vertical  maneuvers  made  with 
the  conventional  display.  The  relative  differ¬ 
ences  between  the  two  displays  suggest  that 
use  of  the  perspective  display  results  in 
avoidance  maneuvers  that  achieve  greater 
separation  between  aircraft. 

The  current  experiment  was  designed  to 
test  performance  accuracy  of  subjects  who 
must  detect  a  threat  and  select  the  closest  in¬ 
terceptor.  Subjects  were  required  to  perform 
both  tasks  (detect  a  threat  and  select  the  clos¬ 
est  interceptor  for  each  threat)  in  order  to 
compare  performance  in  two  display  condi¬ 
tions:  the  conv'entional  display  and  the  per¬ 
spective  display. 

The  fundamental  difference  between  the 
two  displays  was  the  manner  in  which  alti¬ 
tude  information  was  presented  to  the  opera¬ 
tor.  In  the  conventional  display  condition 
subjects  were  required  lo  press  a  key  on  the 
keyboard  to  enter  the  detect  mode,  followed 
by  "hooking”  the  symbol  to  obtain  altitude 
information.  In  the  perspective  display  con¬ 
dition  vertical  separation  was  more  readily 
presented  on  the  screen.  However,  the  sub¬ 
ject  still  had  the  option  of  hooking  the  sym¬ 
bol  to  obtain  an  exact  numerical  representa¬ 
tion  of  the  altitude.  This  numerical  value  was 
presented  in  the  top  right  comer  of  the  dis¬ 
play. 

Variables  and  Hypotheses 

The  within-subjects  independent  variable 
was  display  condition  (conventional  and  per¬ 
spective).  The  dependent  measures  were  (1) 
latent  time  to  detect  possible  threats,  (2)  re¬ 
sponse  time  for  selection  of  interceptors,  (3) 
number  of  incorrect  selections  (false  alarms), 
and  (4)  number  of  omissions  for  both  threats 
and  interceptors. 
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Based  on  previous  research  (Ellis  and 
McGreevy,  1983;  Merritt,  1982;  Uttal,  Azzato, 
and  Brogan,  1982),  it  was  hypothesized  that 
subjects  would  select  the  correct  interceptor 
for  detected  threats  quicker  and  more  accu¬ 
rately  with  the  perspective  display  than  with 
the  conventional  tactical  display.  It  was  ex¬ 
pected  that  no  significant  differences  would 
be  found  in  search  and  detection  between  the 
conventional  display  and  the  perspective  dis¬ 
play. 

METHOD 


Subjects 

The  subjects  were  2 1  male  staff  operational 
personnel  from  surrounding  naval  facilities 
who  qualified  for  this  experiment  by  passing 
a  visual  acuity  test  with  a  corrected  vision  of 
20/20.  Subjects  had  a  mean  of  9.4  years  of 
naval  experience  and  a  mean  age  of  29.7 
years  (range  24-36). 

Equipment 

The  Genisco  Mode)  6210  high-resolution 
graphic  display  terminal  with  a  Microvax  II 
as  a  host  via  DMA  (Direct  Memory  Access) 
were  used  for  both  the  conventional  and  per¬ 
spective  display  conditions.  The  display  was 
14  inches  wide  x  11  inches  high  (35.6  cm  x 
27.9  cm)  with  a  resolution  of  1392  x  1024 
pixels.  Symbol  width  on  the  conventional 
2-D  display  was  4.8  mm  and  symbol  height 
was  3.0  mm.  Symbol  size  varied  on  the  per¬ 
spective  display  from  4.4  mm  wide  and  2.7 
mm  high  for  distant  symbols  to  5.1  mm  wide 
?T>d  3.2  mm  high  for  the  closest  symbols.  The 
display  represented  a  circular  area  with  a  24- 
mile  (38.7-km)  radius.  Ownship  was  posi¬ 
tioned  in  the  center  of  the  area.  Figures  1  and 
2  show  samples  of  the  two  displays. 

A  digitizer  pad  and  pen  were  used  to 
"hook”  symbols  on  the  dicpiav.  Subjects  used 
three  keys  on  the  Genisco  keyboard  to  select 


Figure  1 .  Conventional  display. 


the  desired  mode  (pick,  detect,  or  intercept). 
In  addition  to  written  instructions,  the  exper¬ 
imental  task  was  demonstrated  with  an 
8-mm  videocassctte  recorder  on  a  19-inch 
Sony  color  monitor.  A  standard  visual  acuity 
chart  (Form  2C)  was  used  to  test  vision. 

Scenario 

A  large  sea  was  the  location  for  the  30-min¬ 
ute  scenario.  Only  30  symbols  were  presented 
on  the  display  at  any  one  time.  When  a  craft 
left  the  24-mile  area  portrayed  on  the  dis¬ 
play,  another  craft  appeared.  Fifteen  threats 
were  interspersed  throughout  the  30-minute 
scenario.  A  threat  was  defined  as  any  hostile 
aircraft  that  appeared  on  the  display  or  any 
unknown  aircraft  that  left  an  air  corridor.  In 
all  scenarios  the  tactical  symbology  repre¬ 
sented  ownship  (aircraft  carrier),  15  friendly 
aircraft.  12  unknown  aircraft,  and  8  hostile 
aircraft. 

Experimental  Design 

The  experimental  design  ■.^as  a  one-way 
within-subjects  design.  Each  subject  was 
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tested  in  both  the  conventional  and  perspec¬ 
tive  display  conditions.  For  this  experiment 
the  perspective  display  was  fixed  at  a  41 -deg 
viewing  angle,  whereas  the  conventional  dis¬ 
play  showed  the  traditional  PPI  (Plan  Posi¬ 
tion  Indicator)  overhead  view  with  ownship 
centered  on  the  display.  Shape  coding  de¬ 
noted  the  category  of  the  symbol  (surface, 
subsurface,  or  air)  and  the  identity  of  the 
craft  (friendly,  hostile,  or  unknown). 

The  same  two  scenarios  were  used  for  all 
subjects  in  both  display  conditions.  The  sce¬ 
narios  differed  in  only  one  respect:  each  sce¬ 
nario  had  a  different  sequence  of  threats  to 
which  the  subjects  were  instructed  to  re¬ 
spond. 

Procedure 

Subjects  were  tested  in  a  partitioned  area 
in  a  computer  laboratory.  Normal  staff  oper¬ 
ations  continued  in  the  laboratory  surround¬ 
ing  the  testing  area;  however,  the  testing  area 
was  covered  with  an  opaque  tarpaulin  so  that 
illumination  resembled  the  darkened  room 
in  the  Combat  Information  Center  (CIC). 
Consequently,  noise  and  illumination  repli¬ 
cated  normal  CK.  operating  conditions. 

Each  subject  was  first  administered  the  vi¬ 
sual  acuity  test.  After  confirming  20/20  (cor¬ 


rected)  vision,  the  subject  was  given  written 
instructions  about  the  task.  The  first  task  re¬ 
quired  subjects  to  search  the  display  and  de¬ 
tect  any  threats.  Each  of  the  15  threats  ap¬ 
peared  on  the  display  one  at  a  time.  The 
second  task  consisted  of  choosing  the  closest 
interceptor  (the  friendly  aircraft  that  was 
nearest  the  detected  threat  both  horizontally 
and  vertically).  Instructions  described  the 
three  modes  of  operation:  pick,  delect,  and 
intercept.  The  pick  mode  was  used  to  gain 
only  a  numerical  value  for  the  altitude  of  any 
hooked  symbol  on  the  display.  The  altitude 
was  then  presented  in  the  top  right  corner  of 
the  display.  The  detect  mode  was  used  to  tar¬ 
get  a  threat  for  interception.  The  third  mode, 
intercept,  was  used  to  select  an  appropriate 
interceptor.  The  subjects  used  three  keys  on 
the  Genisco  keyboard  to  select  the  desired 
mode.  In  all  three  of  these  modes  peripheral 
equipment  was  used.  The  subjects  were  in¬ 
structed  on  the  use  of  the  peripheral  digitizer 
pad  and  pen.  The  digitizer  pad  and  pen  con¬ 
trolled  a  crosshair  (cursor)  on  the  screen.  It 
was  with  the  crosshair  that  the  desired  craft 
was  pinpointed  for  altitude  information,  tar¬ 
geting,  or  interception,  depending  on  which 
mode  the  subject  was  operating.  Subjects 
were  instructed  to  work  as  quickly  and  accu¬ 
rately  as  possible. 

After  reading  the  instructions,  the  subject 
watched  an  eight-minute  video  to  become  ac¬ 
quainted  with  the  equipment.  Then  the  sub¬ 
ject  was  presented  with  a  practice  scenario 
consisting  of  four  threats  and  lasting  a  total 
of  five  minutes.  When  the  practice  scenario 
was  successfully  completed,  the  subject  was 
tested  on  the  first  thirty-minute  scenario.  A 
five-minute  break  was  given  to  each  subject 
after  the  first  scenario  and  before  commenc¬ 
ing  the  second  scenario.  After  completion  of 
the  second  scenario,  the  subjects  were  given  a 
questionnaire  a'-king  information  aheut  pref¬ 
erence  for  display  condition,  age,  years  in  ser¬ 
vice,  and  relevant  experience.  The  subjects 
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were  then  debriefed  and  thanked  for  their 
participation. 

Data  Collection 

Detection  latency  for  each  threat  and  re¬ 
sponse  time  for  each  interception  were  re¬ 
corded  automatically.  Mean  latency  and 
mean  response  time  for  each  subject  were 
computed.  Errors  —  including  omissions, 
false  detections,  and  false  interceptions  — 
were  recorded  for  all  events. 

RESULTS 

Analyses  of  variance  (ANOVAs)  were  per¬ 
formed  to  discover  any  significant  differences 
between  the  perspective  display  and  the  con¬ 
ventional  display  for  the  number  of  errors 
and  reaction  time.  All  within-subjects  analy¬ 
ses  for  the  perspective  and  conventional  dis¬ 
play  conditions  included  subjects  with  data 
in  both  experimental  conditions.  The 
ANOVAs  showed  that  significantly  fewer 
errors  were  made  using  the  perspective  dis¬ 
play.  Figure  3  displays  the  mean  errors  for 
each  task. 

An  analysis  of  total  errors  for  the  task  of 
detecting  threats  showed  that  significantly 
fewer  total  errors  (false  detections  and  omis¬ 
sions)  were  made  in  the  perspective  display 
condition,  F(l,19)  =  5.84,  p  <  0.05.  False  de¬ 
tections  refer  to  symbols  that  were  incor¬ 
rectly  selected  as  a  threat.  Omissions  are 
threats  that  were  not  detected.  The  largest 
advantage  found  for  the  perspective  display 
was  the  substantial  reduction  of  errors  for 
the  task  of  selecting  interceptors,  F(l,19)  = 
66.32,  p  <  0.01.  This  finding  was  consistent 
for  both  false  interceptions  and  omissions. 
False  interceptions  refer  to  symbols  that 
were  incorrectly  selected  as  the  closest  inter¬ 
ceptor.  If  the  subject  failed  to  select  an  inter¬ 
ceptor,  an  error  of  omission  was  made. 

The  results  of  the  analysis  showed  that  re¬ 
sponse  time  for  interceptor  selection  was 
shorter  for  the  perspective  display,  F(l,19)  = 


58.94,  p  <  0.01 ,  than  for  the  conventional  dis¬ 
play  (see  Figure  3).  However,  no  significant 
differences  in  response  time  were  found  be¬ 
tween  the  two  display  conditions  for  threat 
detection. 

A  post  hoc  ANOVA  was  also  performed  to 
ensure  that  no  learning  effect  was  present  for 
the  display  or  scenario  conditions.  No  learn¬ 
ing  or  order  effect  was  present.  Regression 
analyses  were  performed  to  determine  any 
correlation  between  (1)  response  time  and 
errors  for  the  combined  tasks  of  detecting 
threats  and  selecting  interceptors  for  both 
display  conditions  (perspective  and  conven¬ 
tional)  and  (2)  response  time  and  errors  for 
each  task  (detect  only  and  intercept  only)  for 
both  display  conditions.  No  significance  was 
found. 

DISCUSSION 

The  results  of  this  experiment  clearly  show 
the  utility  of  the  perspective  display  in  re¬ 
ducing  errors  of  all  types  and  in  decreasing 
reaction  time  to  send  interceptors.  It  was  ex¬ 
pected  that  subjects  would  have  slower  re¬ 
sponse  times  for  selecting  interceptors  in  the 
conventional  display  because  subjects 
needed  to  use  the  "pick”  key  to  determine  the 
precise  altitude  of  possible  interceptors. 

The  perspective  display  significantly  re¬ 
duced  errors  in  interceptor  selections.  This 
finding  was  expected  given  the  graphic  repre¬ 
sentation  of  the  interceptors’  altitude  in  rela¬ 
tion  to  the  hostile  or  unknown  craft.  How¬ 
ever,  the  perspective  display  significantly 
reduced  detection  errors  as  well,  which  was 
not  expected.  Because  the  perspective  dis¬ 
play  has  tic  marks  attached  to  each  air  sym¬ 
bol,  it  was  initially  thought  that  these  addi¬ 
tional  tic  marks  might  cause  a  sensory 
overload  in  subjects.  This  possibility  was  dis¬ 
proved,  however,  as  subjects’  detection 
errors  were  reduced  significantly  in  the  per¬ 
spective  display  condition  when  compared 
with  the  conventional  display  condition.  The 
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MEAN  ERRORS 


CONDITION  DETECT  INTERCEPT 


CONVENTIONAL 

2.78 

80 

DISPLAY 

•(0.08) 

‘{1.76) 

PERSPECTIVE 

1.83 

4.83 

DISPLAY 

•(0.08) 

•(1.34) 

MEAN  RESPONSE  TIME  IN  SECONDS 


DETECT  INTERCEPT 


CONVENTIONAL 

45.65 

84.10 

DISPLAY 

•(9  67) 

•(8.79) 

PERSPECTIVE 

41.06 

54.93 

DISPLAY 

•(9.26) 

•(9,59) 

_ 1 

•  STANDARD  DEVIATION 
Figure  3.  Mean  errors  and  reaction  limes. 

perspective  display  reduced  all  types  of 
errors  and  clearly  could  help  Navy  Tactical 
Data  System  (NTDS)  operators  do  their  job 
better. 

A  survey  with  a  comment  section  was  given 
to  each  subject  at  the  conclusion  of  the  test 
period.  Many  subjects  commented  that  the 
graphically  depicted  vertical  separation  in 
the  perspective  display  condition  was  an  e.x- 
cellent  feature  that  could  expedite  intercep¬ 
tor  selection  for  operation  specialists  in  the 
fleet.  Nineteen  subjects  preferred  the  per¬ 
spective  display.  The  remaining  three  sub¬ 


jects  preferred  the  conventional  display  be¬ 
cause  they  were  familiar  with  it. 

Display  density  and  complexity  were  not 
studied  in  this  experiment.  Future  research  is 
necessary  to  determine  the  effects  of  overlap¬ 
ping  symbols  and  data  tags  in  order  to  effec¬ 
tively  evaluate  the  usefulness  of  the  perspec¬ 
tive  display  for  the  Combat  Information 
Center.  Among  the  factors  that  still  need  to 
be  investigated  before  this  display  can  be  im¬ 
plemented  are  the  usefulness  of  color  coding 
in  this  particular  display,  display  density  and 
complexity,  and  the  effect  of  the  rotated  field 
of  view  on  operator  performance. 

The  use  of  a  perspective  display  for  other 
applications  was  also  investigated.  It  has 
been  suggested  that  one  possible  application 
for  the  perspective  display  might  be  the  Mine 
Warfare  Planning  System  (T.  Hass,  personal 
communication,  December  1984).  Mine  areas 
are  commonly  viewed  as  a  cylinder  when  in 
reality  they  are  usually  a  series  of  spheres  or 
a  single  hemisphere  centered  on  the  bottom, 
and  future  research  could  investigate  the  use 
of  perspective  displays  as  an  alternative  to 
present  mapping  methods.  Several  subjects 
also  mentioned  the  potential  use  of  this  dis¬ 
play  for  air  traffic  control  as  well  as  for  air 
intercept  control  in  the  Combat  Information 
Center. 

SUMMARY  AND  CONCLUSIONS 

This  experiment  revealed  a  significant  re¬ 
duction  in  errors  of  detection  and  intercep¬ 
tion  with  the  use  of  the  perspective  display. 
As  expected,  response  time  for  selecting  in¬ 
terceptors  was  greatly  reduced  in  the  per¬ 
spective  display  condition.  No  difference  ex¬ 
isted  in  response  time  for  threat  detection 
between  the  two  display  conditions.  The  re¬ 
gression  analyses  showed  that  no  correlation 
existed  between  (1)  response  time  and  errors 
for  the  combined  tasks  of  detecting  threats 
and  selecting  interceptors  for  both  display 
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conditions  (perspective  and  conventional) 
and  (2)  response  time  and  errors  for  each  task 
(detect  only  and  intercept  only)  for  both  dis¬ 
play  conditions. 

The  results  of  this  experiment  show  that 
the  perspective  display  has  the  potential  to 
reduce  errors  and  response  time  for  air  inter¬ 
cept  controllers  in  the  Combat  Information 
Center.  Before  this  type  of  display  can  actu¬ 
ally  be  implemented  in  the  fleet,  however,  it 
is  essential  that  display  density  and  com¬ 
plexity  be  studied  on  the  perspective  display. 
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